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Abstract 

For a birth-death process subject to catastrophes, defined on the state- 
space iS — {r, r+l, r+2, . . .}, with r a positive integer or zero, the first- visit 
time to a state A: G 5 is considered and the Laplace transform of its prob- 
abihty density function is determined, use of which is then made to obtain 
mean and variance. The Laplace transform of the probability density 
function of the first effective catastrophe occurrence time and its expected 
value are also obtained. Some extensions to time-non-homogeneous pro- 
cesses are then provided. Finally, certain additional results concerning 
the determination of the steady-state distribution and the representation 
of the transition probabilities are worked out, while some applications to 
particular birth-death processes are shown in the Appendix. 
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1 Introduction 



Great attention has been paid in the literature to the description of the evo- 
lution of systems modeled via discrete state-space random processes such as 

*short title; "Birth-death processes in the presence of catastrophes" 
^Corresponding author 
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populations evolving in random environments or queueing and service systems 
under various operating protocols. However, with a few exceptions that will 
be indicated below, in these studies the systems under considerations are not 
subject to catastrophes, neither a target of investigation has been the time 
distribution when a preassigned state is reached. Among the relevant contri- 
butions to the area in which the present paper belongs, the following should 
be recalled: (i) The results concerning the distribution of the extinction time 
for a linear birth-death process subject to catastrophes and, in particular, the 
determination of necessary and sufficient conditions for population extinction 
to occur 121, HI; (ii) the evaluation of the stationary probabilities of a simple 
immigration-birth-death process influenced by total catastrophes (in) the 
studies on the transient and equilibrium behaviors of immigration-birth-death 
process with catastrophes (5], jl6j : (iv) the analysis of linear birth-death pro- 
cesses under the influence of Poisson time-distributed catastrophes whose effect 
is to enhance the death probability j^J, Jl]; (v) the determination of the tran- 
sient and the limiting distributions of continuous-time Markov chains subject 
to catastrophes occurring according to renewal processes W', (vi) analysis of the 
effect of catastrophes in the case of M/M/1 queueing systems &^ and when the 
number of initially present customers is random 

The determination of the distribution of the time when the zero-state is 
reached for the first time, studied in some of the above papers, is clearly of 
interest within the context of population dynamics (cf. extinction problems) or 
in operations research (cf. the running out of stored supplies, the disappearance 
of a queue at a service station, etc.). However, no mention appears to have been 
made so far on the determination of the distribution of the time when first a 
discrete continuous-time Markov process of birth-death type visits a preassigned 
non-zero state when subject to catastrophes, i.e. to the fist-visit-time problem. 
This is the object of the present paper. 

It should not pass unnoticed that the fist-visit-time problem bears partic- 
ular relevance in contexts such as populations for which extinction does not 
occur only when population size vanishes, but is an automatic consequence of 
its size reduction below some critical values (think of bisexual populations or 
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environmental effects by wliicli very low densities random mating individuals 
automatically lead to sure extinction JHI)- Moreover, it is conceivable that in 
some instances, due to environmental regulation effects when a system reaches 
too large a size some new phenomena may arise whose effect may be determi- 
nant on the further evolution of the system, such as the stop of the access to a 
service provider if a waiting room fills up, the block of an information processing 
system as a consequence of excessive service demands, cannibalism phenomena 
among starving animal populations, etc., all this both in the presence and in 
the absence of catastrophes. In all such cases, the problem arises of determining 
the "statistics" of the time when a generally non-zero preassigned state is for 
the first time reached by the system under consideration. 

In the sequel, we shall preliminarly establish certain relations among tran- 
sition probabilities in the presence and in the absence of absorbing states, and 
then reduce the study of the dynamics of the process in the presence of catas- 
trophes to that of a process insensitive to catastrophes, whose description is in 
principle more easily achieved. Some additional results and illustration exam- 
ples to particular birth-death processes will be briefly outlined in the Appendix. 

More specifically, in Section 2 we shall analyze the first-visit time of a birth- 
death process with catastrophes {N{t); t > 0} to any preassigned state k € 
S = {r, r + 1, r + 2, . . .}, with r a positive integer or zero, by considering 
separately the cases of first visit to state r and to state k ^ r. We shall 
disclose various functional relations that allow to describe N{t) in terms of the 
corresponding birth-death process {N{t);t > 0}, defined on the same state- 
space S and characterized by the same birth and death rates as N(t), but for 
which catastrophes are absent. In particular, for N{t) we obtain the Laplace 
transform of the probability density function (pdf ) of the first-visit time to state 
k and calculate its mean and variance. 

We point out that since N{t) is skip-free to the right, all intermediate states 
are visited only when the first visit to state k occurs from a starting state j < k. 
Note that, because of the assumed presence of catastrophes, this need not occur 
if j > k. 

The problem of the first occurrence of catastrophe is faced in Section 3, 
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where the Laplace transform of the catastrophe's first-occurrence time pdf and 
its mean are obtained. Our approach is analogous to that exploited in |H| for a 
special birth-death process of interest in queueing theory. In Section 4 we shall 
obtain the expressions of the transition probabilities and of the density of the 
first-visit time of N{t) to state r in the special case when this process is time 
non-homogeneous and catastrophes occur with time-varying rates. In Section 
5 we express the steady-state probabilities of N(t) in terms of the Laplace 
transforms of the transient probabilities of N{t), and provide a probabilistic 
interpretation of the transition probabilities of N{t). Indeed, we show that 
N(t) has the same distribution as the minimum between the random variable 
that describes its steady state, and an independent birth-death process whose 
rates suitably depend on those of N{t). 

Some examples of applications of our results are finally given in the Ap- 
pendix for birth process, immigration-emigration process, immigration-death 
process, and immigration-birth-death process in the presence of catastrophes. 

2 First-visit-time problem 

Let {N{t); t > 0} be a birth-death process with catastrophes defined on the 
state-space S = {r, r + 1, r + 2, . . .}, with r zero or a positive integer, such that 
transitions occur according to the following scheme: 

(i) n ^ n + 1 with rate a„, for n = r,r + 1, . . ., 

(ii) n — > n — 1 with rate for n = r + 2,r + 3, . . ., 

(iii) r + 1 ^ r with rate (3r+i + ^, 

(iv) n ^ r with rate ^, for n = r + 2, r + 3, . . .. 

Hence, births occur with rates a^, deaths with rates /?„, and catastrophes 
with rate ^, the effect of each catastrophe being the instantaneous transition to 
the reflecting state r. For all j,n £ S and i > the transition probabilities 



p,, = P{N{t) 



n \ iV(0) = j} 



satisfy the following system of forward equations: 




("r + OPjA^) + Pr+lPj,r+lit) + t 
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+Pn+iPj,n+i{t), n = r + l,r + 2, . . . , 

with initial condition 



"io"'^'''"^"^ 1 0, otherwise. 



Denote by {N{t); t > 0} the time- homogeneous birth-death process ob- 
tained from N{t) by removing the possibihty of catastrophes, i.e. by setting 
^ = 0. Its transition probabihties 

Pj^n{t) = P{iV(t) = n I iV(0) = i}, j, n G 5, t > 

then satisfy the system of forward equations obtained from by setting = 0, 
with initial condition \\mf)jn{t) = 6j n- 

Hereafter, we shall restrict our attention to non-explosive processes N(t), 
i.e. we shall assume that J2n=rPj-n{t) = 1 for all j ^ S and t > 0. 

We note that some descriptors of N{t) can be expressed in terms of the 
corresponding ones of N{t). Indeed, making use of the forward equations for 
probabilities Pj,n{f) and for pj^n{t), for all j,n ^ S and t > we have: 



Pj,n{t) = e-^'pj,n{t) + i / e-^^p,,n{T) dr. (2) 







As an immediate consequence of Eq. 0, we can express the conditional mo- 
ments of N{t) in terms of those of N{t) as follows: 

E[N{t) I A^(0) = j] = e~«* E[N{t) \ N{0) = j] + ^ / e"«^ E[N{t) \ N{0) = r] dr. 

Jo 

(3) 

Moreover, by setting 

;'+oo r+oo 

7rj-„(A):=/ e~^'pj^nit)dt, ^fj-„(A) := / e"^* p^, dt, A > 0, 



from it follows 

vrj,„(A) =7fj-„(A + + ^^r,n(A + 0, A>0. (4) 
Let us define the first- visit time of N{t) to state k G S as 

Tj^k := inf{t > : N{t) = k}, N{0) =jeS, k, (5) 



and denote its pdf by 

9 J At) = ^ 
Moreover, for the corresponding birth-death process N{t) in the absence of 
catastrophes, we shall denote by Tj^f. the first-visit time, and by gj,k{t) its pdf. 

We shall now analyze the first- visit-time problem. To this purpose, 7j,fc(A) 
and ^j,k{\) will denote the Laplace transforms of gj^t) and gj^kit), respectively. 
Furthermore, for all t > and k,j, n S, with j ^ k and n ^ k, let 

:= F{N{t) = n, N{t) / Vr € (0, t) \ N{0) = j} 

be the /c-avoiding transition probability of N{t), and let Aj'^{t) denote the 
corresponding probability for N(t). For all t > these functions are related as 
follows: 



1- E ^nit), J>k 



n=k+l 



k-1 



(6) 



?i=r 

+ 00 



5rj-fc(r)dr = < 



n — r 



k-l 



(7) 



where /g (7j^jt(r) dr is the probability that A^(t) enters state k before time t, 
and J^n^fli't) is the probability that N{t) does not enter state k up to time 
t. Hereafter, Aj''l{X) and ^j'^^lA) "wiH denote the Laplace transforms of Aj''l{t) 
and ^j'^l*)! respectively. 

The first- visit-time problem will be discussed in three different cases: (i) 
first visit in state r, (ii) first visit in state k > r starting from below, (in) first 
visit in state k > r starting from above. 

2.1 First visit in state r 

Recalling the r-avoiding transition probabilities of N{t) and N{t) for all 
t > are related as follows: 



All^it), j,n€{r + l,r + 2,...}. 



(8) 



Hence, the probability of a transition of N(t) from j to n (n > r) at time t in 
the absence of visits to state r equals the probability of the same transition for 
N{t) times the probability e^^* that no catastrophe occurs in (0, t). 

The following proposition expresses gj,r{t) and 7j,r(A) in terms of ^j^r(t) and 
7j>(A), respectively. 



Proposition 2.1 For j G {r + 1, r + 2, . . .} the following equations hold: 



A 







7j>(A) 



7j,r(A + + 



5j>(t) dr 



t > 0, 



A > 0. 



A + e A + r 

Proof. Making use of Eq. © and ((TJ for k = r, from © we obtain: 

/ 5,,.(r)dr = l-e-«* 

•^0 n=r+l 



(9) 
(10) 



1 - e 



1 



9j,r{r)dT 



(11) 



Differentiating both sides of ()11|1 with respect to t we are led to ©• Taking 
the Laplace transform of both sides of @ and making use of Fubini's theorem 
we then have: 



7j,r(A) = 7j,r-(A + + 



-(A+C)t 



dt 



dr, 



A > 0, 



from which Eq. (jlUp follows. ❖ 

In the limit as t ^ +oo, from Ullj) we obtain /q''"^ gj,r{'T) dr = 1, implying 
that the first visit of N{t) in state r occurs with probability 1, whereas for N{t) 
such probability may be less than 1. 

A characterization of the distribution of the first-visit time in state r is 
provided by the following 

Theorem 2.1 Let Z be an exponentially distributed random variable indepen- 
dent ofTj^r with mean . IfP(Tj^r < +oo) = 1, then for j € {r + l,r + 2, . . .} 
the r.v. 

Qj^r '■= mill {Tj^rj ■Z^} (12) 



has the same distribution as Tj^r- 
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Proof. From (fT^ we have: 

P{Qj,r <t) = l- e"^* + e-^* <t)= F{Tj^r <t), t> 0, 

where the last equahty follows from This completes the proof. o 
2.2 First visit to state k 

We shall investigate the first-visit-time problem to any state k £ S. Note that 
the case j = r and k = r + 1 is trivial and 

gr,r+iit) = ar e"""*, A^;/'\t) = e-""*, t > 0. 

In the following theorem 7j,fc(A) is expressed in terms of 7j,A:(A). 

Theorem 2.2 For all X > and for j, k £ S , j ^ k, there results: 

Proof. For all t > and for j, k £ S, j ^ k, the following renewal equation 
holds: 

Pj,k{*) = [ 9j,k{'^)Pk,k{t-T)dT, (14) 
JO 

Taking the Laplace transform of ()14|) and recalling Q we have: 

that leads one to (|T^ by virtue of the relation 7j,fc(A) = vfj j!;(A)/7ffc^fc(A), A > 0. 

Setting A = in Eq. ([131) yields 7^,^(0) = 1, so that the first visit of N{t) to 
any state k occurs with unit probability, whereas for N{t) this event may occur 
with probability less than 1. We note that Eq. ((T^ reduces to (fTU)) if = r. 

Making use of Eq. ()13() we can now immediately express mean and variance 
of Tj^k in terms of the Laplace transform of gj^rit), for all j, k £ S , j ^ k: 

Var(r,vr) = -^^^ {l - tkiO + 2^1 - 7,,fc(e)]^7r,fc(0 

+2C%k{0^%k{0] ■ (16) 



Eqs. (|15() and (|16|) will be used in the Appendix for the analysis of an 
immigration-emigration process with catastrophes. 

Next proposition yields the Laplace transform of the A;-avoiding transition 
probability 

Proposition 2.2 Under each of the following mutually exclusive assumptions: 
(i) A: G {r + 1, r + 2, . . .} and j, n G {r, r + 1, . . . , A; — 1}, 
(a) n, k £ S , n k, and j G {k + 1, k + 2, . . .}, 
for all X > we have: 

Proof. Under assumptions (i) or (ii) there holds: 

^£(0 = PjAt) - 9j,k{^)Pk,n{t - -r) dr, t > 0. 

Taking the Laplace transform of this equation and recalling Q and we 
obtain: 



-^llW = ^i,n(A + + 1 ^r,n(A + 

A7j,fc(A + e) +^7r.fc(A + 
A + e7r,fc(A + 

that leads us to (fT7|) after some calculations. 



Vrfc,n(A + + 1 T^r,n{^ + 



We point out that under assumption (i) of Proposition 12.21 from the well- 
known relation 







we obtain: 



•^),nW = %n(A) - 7i,fc(A) ^fc,n(A), A > 0. 

Eq. (fT7|) can thus be also expressed as 

^£(A) = Afl{X+OH 4S(A+0, J,nG {r,r+l,...,k-l}. 
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We remark that since N{t) is not skip- free to the left, Aj j^{X) cannot be ex- 
pressed in terms of A^^l^{X) when j > k. Moreover, since N{t) is skip-free to 
the right, for all t > and j E {r,r + 1, . . . ,k — 1} the following equation holds: 

9j,kit) = [ 9j,n{'T)9n,k{t-T)dT, U = j + 1, j + 2, . . . , k - 1. (18) 

Jo 

Instead, Eq. I|18() does not hold when j > k because N{t) is not skip-free to the 
left. 

3 First occurrence of effective catastrophe 

This section focuses on "effective" catastrophes, i.e. on catastrophes that are 
able to change the state of N{t). Therefore, the occurrence of catastrophes 
while the process is in state r is not taken into account. Consequently, the 
catastrophes first-occurrence time is no longer exponentially distributed. 

Let us denote by Cj^r the first occurrence of an effective catastrophe, when 
A^(0) = j, with j G S. An effective catastrophe, or shortly "a catastrophe" 
from now on, produces a transition, with rate ^, from any state n > r to the 
reflecting state r. Hence, certain transitions from r + 1 to r may be due to the 
occurrence of a catastrophe (with rate S,), whereas the remaining transitions 
are due to a death (with rate Pr+i)- 

In order to investigate on the features of Cj^r, let us refer to a modified 
birth-death process with catastrophes that will be denoted as {M{t); t > 0}. 
This is assumed to be defined on the state-space {r — 1, r, r + 1, . . .}. Its be- 
havior is identical to that of N{t), the only difference being that the effect of a 
catastrophe from state n > r is a jump from n to the absorbing state r — 1. In 
other words, the allowed transitions are the following: 

(i) n ^ n + 1 with rate a„, for n = r, r + 1, . . ., 

(ii) n ^ n — 1 with rate for n = r + 1, r + 2, . . ., 

(iii) n — > r — 1 with rate ^, for n = r + 1, r + 2, . . .. 

For all t > and j G 5, n G {r — 1, r, r + 1, . . .}, let us now consider the 
transition probabilities of the modified process 

/i,-„(t) =P{M(t) =n|M(0) = j}. 
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The link between M{t) and Cj^r is evident by noting that the transitions of 
M(t) from n > r to r — 1 corresponds to the transitions of N{t) from n to r 
due to a catastrophe. Hence, denoting by dj^rit) the density of Cj^r for alH > 
we have: 

P{Cj r<t)= I djrir) dr = hj r-i(t), j G S. (19) 
Jo 

Moreover, for ah j G 5 the following system of forward equations holds: 

^hj^r-l{t) = ? [1 - hj^r-l{t) - hj^rit)], 

^hj^n{t) = -{an + f3n + hj,n{t) + On-l hj.n-l{t) + (3n+l hj>n+l{t), (20) 



n = r + l,r + 2, . . . , 

with initial condition 

Let us denote by rjj^nW the Laplace transform of hj^n{t)- In the following 
theorem we shall express i]j^nW in terms of vfj „(A). 

Theorem 3.1 For all j € 5 and X > we have: 



1 vfj„(A + 



(21) 



r?j,n(A) = vr,- „(A + + C ^fr,n(A + ""fj^^^^l.. , n = r, r + 1, . . . . (22) 

Proof. We shall prove the theorem by considering separately the two cases 
(a) j = r and (b) j > r. 

(a) Let j = r. Taking the Laplace transform of second and third equation 
in (|2U|1 . we obtain: 

(A + Or) ?/r,r(A) - 1 = 7?r,r+l(A), 

{X + an + Pn + ^r,r(A) = a„_i r/r,n-i(A) + /3„+i r/r,„+i(A), n > r(23) 

Recalling that TTr,n{X) is the Laplace transform of pr,n(i)) '^^ look for a solution 
of the form 

??^,„(A) = ^(A)^,,„(A), n = r + l,r + 2,..., (24) 

11 



where ^(A) does not depend on n. Substituting Eq. in ((23), we obtain: 
^(A) (A + ar) TTrM) - 1 = (3^+1 A{\) 7r^,^+i(A), 

(A + an + /3n + T^rA^) = vr^,n-i(A) + /3„+i 7rr.,„+i(A), n > r. (25) 
Moreover, taking the Laplace transform of it follows: 

(A + + C) 7rr,r(A) - 1 = (3r+l -Kr^r+lW + J, 

(A + a„ + /3„ + vrr,r(A) = a„_i 7r,.,„_i(A) + /3„+i 7rr,„+i(A), n > r. (26) 
Comparing H26|) with (|25() we obtain: 

A(A) ' 



A + e- Ae7r,,,(A)' 

that does not depend on n. By virtue of (|^^ and @, this yields Eq. for 
i = r. 

(b) Let J > r. Taking the Laplace transform of 1)20(1 . we have: 

(A + Or) %>(A) = /?r+l r?j,r+l(A), 

(A + a„ + /?„ + ,^) ??j,„(A) = a„_i ??j,„_i(A) + r/jv«+i(A), n > r, n / j, 
(A + aj + /3j + Vj,jW - 1 = "j-i Vj,j~iW + 
Similarly to case (a) above there results: 

r?,- „(A) = 5(A) TTj- „(A) + C(A) 7r,,„(A), n = r - 1, r, . . . , (27) 

where 

5(A) = 1, C{X)- ^t^"^'^^^)-!] 



A + C-^A7rr,r(A)' 

Hence, making use of ()27|) and Q), some straightforward calculations led us to 
Eq. (|22p for j > r. Finally, taking the Laplace transform of the first equation 
in (|2UI) we obtain: 
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Making again use of © Eq. (^1]) then follows. o 

Let us now denote by 5j,r.(A) the Laplace transform of dj^r(t), j € S. Taking 
the Laplace transform of both sides of (|19() and making use of l|21() . for j £ S 
we have: 

5,,(A) = A,,,-i(A) = - l-Cvr,.(A + - ^''^ 

12 



The following renewal equation for N{t) 

JO 

holding for all j > r, yields: 

^j,rW = 7i,r(A) vfr,r-(A), A > 0. 



Hence, for j > r, (|28j) can be re-written as 

hAX> - XT? + ^^-<^ + ^' - 1 -^a'I Q ■ 

Making use of (|10j) in the right-hand-side, we have an alternative expression for 
(5j>(A), for ah A > and j G {r -M, r 2, . . .}: 

MA)=WA)-X^ ,:-^;^^) . (29) 



Proposition 3.1 For a// j G 5 t/iere holds: 

E(Cj,r) = 7 

Proof. For j > r, (|3nj) follows by differentiating the right-hand-side of (|29|) 
with respect to A and then setting A = 0. The same procedure starting from 
((2H1) yields (jSni) in the case j = r. o 

4 An extension to time-non- homogeneous processes 

In order to extend some of the above results to the time-non-homogeneous 
case, in this section {N{t); t > to}, Iq > 0, will denote a time non-homogeneous 
birth-death process with catastrophes, defined on the state-space S = {r,r + 
l,r -|- 2, . . .}, where births occur with rates a„(t) and deaths with rates (3n{t). 
Moreover, catastrophes are assumed to occur according to a non-homogeneous 
Poisson process characterized by intensity function 5,{t). We assume that an{t)-, 
Pn{t) and S,{t) are continuous bounded functions such that an{t) > 0, Pn{t) > 
and ^(t) > for all t > to, with /+°°^(t)dt = +oo. Moreover, {N{t); t > to} 
will denote the time non-homogeneous birth-death process obtained from N{t) 



(30) 
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by removing the possibility of catastrophes, i.e. by setting ^(t) = for all t > to- 
For all t > to and j,n £ S the transition probabilities of N{t) and N{t) will be 
denoted by 

Pj,n{t I *o) = P{N{t) = n I iV(to) = j}, Pj,n{t I to) = P{iV(t) = n \ N{to) = j}. 

(31) 

Assuming that N{t) is non-explosive, i.e. such that J2n=rPj,n{'t I ^o) = 1 for all 
j £ S and t > to, we shall extend Eqs. Q and @ to the time-non- homogeneous 
case. To this end, we note that by making use of the forward equations for 
probabilities for all j,n £ S and t > to there hold: 

^ ^{u)du]pj^nit\to)+ [ 
'to > Jto 



J3j>(t |io) = exp|-y ^{u)dujpj^nit\to)+J ^{t) e^p ^- J ^{u) du^ pr,n{t\T) dr, 

(32) 



and 

ft 



E[N{t) I iV(to) = j] = exp { - ^ C{u) du} E[N{t) \ iV(to) = j] 

+ j^* ^(r) exp { - y* ?(^^) dn} E[N{t) \ N{t) = r] dr. 



'to 

Moreover, similarly to the cases of Eqs. Q and ©, it is not hard to prove that 
the r-avoiding transition probabilities and the pdf's of the first-visit time to 
state r in the time-non-homogeneous case are related as follows for all t > to 
and j G {r + 1, r + 2, . . .}: 

Af,l{t\to) = exp{ - J\{n)du} Afl{t\tQ), n G {r + 1, r + 2, . . .}, 

S'j,r(t I to) = { ~ ^(^) '^^} 3j,r{t I to) 

+ C(t) exp I - C(u) dnj [l - 5,- ,(t | to) drl . (33) 

Let Tj^r denote the first-visit time in state r for the time-non-homogeneous 
birth-death process N{t). The characterization given in Theorem 12.11 can 
be extended to this time-non-homogeneous case. Indeed, let Z he a ran- 
dom variable with hazard function ^(t), t > to, i.e. with distribution func- 
tion F{t) = 1 — exp{— //^j S,{u) du}, t > to. If Z is independent of Tj^r, and if 
P(Tj_r < +oo) = 1, then it is possible to prove that for j G {r + 1, r + 2, . . .} 
the r.v. ()12() has the same distribution as the first-visit time Tj^r- 
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5 Some additional results 



Let us denote by A'^ the random variable that describes the steady state of N{t) 
in the time-homogeneous case, and let 

g„ := P(iV = n) = lim pj- j, n G 5. (34) 

t — ^+oo 

Then, from we obtain: 

-{ttr + 6 9r + Pr+1 Qr+l + ^ = 0, 

-(q„ + /3n + 9n + ttn-l Qn-l + ^n+l = 0, ?! = r + 1, r + 2, . . . . 

(35) 

Making use of a Tauberian theorem, from Eq. (0J) there results: 

qn = i%Ai)^ i>0, neS. (36) 

From the assumed non explosivity of N{t) and from H36() it follows that 
A^(t) possesses a steady-state distribution, with Ylin—r^n = 1- We stress that 
due to H36|). such a distribution can be obtained from the Laplace transform of 
the transition probabilities in absence of catastrophes. Moreover, we underline 
that (|5H)) 's satisfy system 

In Eq. ((21) we have expressed the transition probability of N{t) in terms 
of that of N{t). In order to provide a probabilistic interpretation of Pr,nit), 
let us now introduce a time- homogeneous birth-death process {N*(t); t > 0} 
characterized by birth and death rates 



hoo 



(n>r), P: = Pn'-^^ {n>r), (37) 



J2 Ik Y.1k 

k=n+l k=n 

with state-space 5, where r is a reflecting state. Assuming that P{A^*(0) = 
r} = 1, we denote by p*„(t) the transition probabilities of N*{t). 

Theorem 5.1 Let Ur^n{t) be the transition probabilities of 

U{t) := min{Af*(t), iV}, t > 0, (38) 

where N is independent of N*{t) and distributed as in icl4\ )- Then, 

Ur,ni^) = Pr,n{t) (39) 

for all t > and n € S. 
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Proof. From Eq. (jSHl) it follows 



Ur 



+00 +00 

lit) = Qn PrA'^) +P*,n(0 ^ Ik, n S . 

k=n k=n+l 



(40) 



Differentiating both sides of (|4U() and making use of the forward equations of 
p* we have: 

^Ur,rit) = -a* (1 - qr)p*^rit) + [3*^-^ (1 - Qr) p*^r^iit) , 



— 



+00 +00 \ +00 

J2 Qk+Pn^Qk] P*r,n{i) + <-! Pr,n-1 (*) Ik 

fc=Tt+l k=n J k=n 
+00 

+ /?:+! n = r + l,r + 2,.... (41) 

k=n+l 

Moreover, from 1)40^ we obtain: 

-{Ur + i)Ur^r{t) + [3r+lUr,r+l{t) +i = -a*p*^^{t) + - Qr - g^+l) P*,r+1 (*) ' 

-{an + Pn +C)'"r,n(t) + (t) + Pn+1 Ur,n+lit) 

+ 00 

p*„(t) + an-lPr,n-l(*) X! 



-{an + f3n + C)Ylk + an^lQu-l 
k=n 

+ 00 

+Pn+lPr,n+l{t) Y ^k, 
k=n+2 



k=n—l 



n = r + 1, r + 2, . . . . 



(42) 



Due to and (|n7|). the right-hand-sides of Eqs. (|^T|) and 1)42^ are identical, 
so that Ur^n{t) satisfy the system of forward equations Furthermore, due 
to or H4U() . initial condition nr.^„(0) = 5r^n holds. Hence, (fSUI) follows. o 

An immediate consequence of Theorem 15.11 is that pr^n (t) can be expressed 
in terms of probabilities p*i.{t) and qt- Indeed, due to and (|in|l . for all 
t > and n € 5 we have: 



Pr,n(i) =(lnY Pr,ki*) + Pr,ni*) Y ' 
k=n k=n+l 



(43) 



Hereafter we show that this result can be extended to the more general case 
of arbitrary initial state. 

Theorem 5.2 For all t > and j,n G S we have: 

+ 00 +00 

Pj,nit)=e-^'\PiAt)-Pr,nm+QnYPr,kii)+Pr,nit) Y ^k- (44) 

k=n fc=ra+l 
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Proof. Comparing Eq. Q written for j = r with ()43|) we obtain: 



Jo 



Pr,n(T) dr = Pr,n{t) - 6 Pr,nit) 



k=n k=n+l 



Making use of this equation in @ we are finally led to H44() . o 

Appendix 

Hereafter we shall apply the results obtained above to some birth-death pro- 
cesses with catastrophes of interest in biological contexts. 

Al. Birth process with catastrophes 

Let N{t) denote the number of individuals present at time t in a birth process 
with catastrophes on 5 = {r, r -|- 1 , . . . } , with 

On > (n = r,r-M,...), = {n = r + l,r + 2, . . .). 



We assume that 



+ 00 ^ 

= +00, 

frl an 



so that Yl,n~rPr,n{t) = 1 for alH > (cf. for instance Cox and Miller ^). Since 
1 



7fr,n(A) = < 



n = r, 



we have: 



(A + ar){X + Ur+i) • • • (A a„) ' 

r e 



In = ^T^r,n{0 = ' 



n = r + l,r + 2, . . . , 



n = r, 



^arUr+l ■ ■ ■ Un- 



Note that 

(i) if an = a, then the stationary distribution is geometric: 



n = r + l,r + 2, . . . , 



a 



n = r,r + 1 



, I I J., . . . , 
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(ii) if = ^ (n + /c), with k a positive integer, then the stationary distribution 
is 

r + k 

1n = -( — TlTT — , , , iv n = r,r + l,.... 

[n + k){n + k + 1) 

From (Uni) and (|1H1) it fohows gj^r{t) = dj^r{t) = ^e'^*, t > 0. 

A2. Time non-homogeneous immigration-emigration process with 
catastrophes 

Let N(t) be the continuous-time Markov chains with state-space {0, 1, . . .} that 
describes the number of individuals in a population subject to an immigration- 
emigration process in the presence of catastrophes, with immigration rates 
a„(t) = aw{t), emigration rates = (3w{t) and catastrophe rate ^(t), 

with a > 0, P > and where w{t) is a bounded, continuous and positive func- 
tion such that Jf^°° dt = +oo. Making use of some well-known results (see, 
for instance, Medhi JH] and Bailey PQ), for N{t) in the absence of catastrophes 
we have: 

rt 
to 

t , , rt 



Pj,n{t I to) = exp I - (q + ^) w{u) diij 

p{n-j)/2 uj{u) duj + I^^-^-^ (l^/^ " w{u) du) 



+00 „j 

+(1 - p)/5" P'""'^ (27^ / w{u) du 

•'to 



k=n+j+2 

and: 



(45) 



9j,o{t\to) = J""!^^} , expf-(a+/3) f w{u) du] p'^ 1^2^ f w{u)du), 
j^^w{u)du ^ Jto ^ Jto ' 

where p = a/ (3. Hence, the transition probabilities and the first- visit-time 
density of N{t) can be easily obtained by making use of and (|33j) . 

A3. Immigration-emigration process with catastrophes 

Let N[t) denote the number of individuals in a population subject to an immi- 
gration-emigration process with catastrophes and characterized by constant 
birth and death rates = a and /3„ = /3, with state-space S = {0,1,...}. 
Since (see, for instance. Section 3.1 of Conolly 0) 

^o,n(0 = 7(1-9)^", n = 0,1,2,..., 
18 



with 



a + P + ^-V{a + P + ^y- 4a/? 
2/3 



(46) 



Eq. shows that the steady-state probabihties for the corresponding process 
N{t) are given by: 

g„ = (l-g)(?", n = 0,l,2,.... (47) 

By virtue of (|S7j) and (|T7I) . the birth-death process N*{t) is characterized by 
the following rates: 

«: = ^ (n>0), P*=Pq in>l). 
Making use of (|44() for all t > and j, n € {0, 1, . . .}, we have: 

+ 00 

pU^) = e-^* [pUt)-PoAt)] + (1 - E^'S.fcW +l'S,nW'/"+\ (48) 



k=n 



where (see for instance Eq. (9.13) of Medhi 13 , p. 120) 



PQ,n{t) = exp 

+^1 



a 



+ (3q]t 



n/2 



n +00 

E 

k=n+2 



In{2^a[5t) + 

-k/2 



(n-l)/2 



'n+1 



(2Va/3t) 



h{2^a[3t) 



with p = a 1(5, and where Pj^nit) identifies with expression H45() upon setting 
u)(t) = 1. We note that Eq. (|48|1 extends the results obtained in Section 2 of 
[S] in which the case of initial state j = is treated. 

Let us discuss the first-passage time of N(t) in state r. Since r = 0, in this 
case we have (see, for instance, Conolly |6j): 



%o(e) 



f3 \^ 

-q 

a 



+ g + /3 - V(e + g + /?)" - 4a/3 y 
I 2g ; ' 



(49) 



where q is defined in H46|) . Making use of Eqs. ()15() and 1)16(1 we thus obtain mean 
and variance of the first-visit time in state in the presence of catastrophes: 

1 



E(T„o) 



Var(T,-o) 



g 



1 



1 



1 



(50) 



(51) 



a 2(3q-{i + a + 13) 
Finally, recalling (j49|) , from (j3()|) we obtain the mean time of the first occurrence 
of an effective catastrophe: 



1 i^'? f(3 



g 
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A4. Immigration-death process with catastrophes 

Let N(t) denote the number of individuals present at time t in an immigrations- 
death process with catastrophes. Its state-space is {0, 1, . . .}, and its birth and 
death rates are 

a„ = 1/ (n = 0, 1,...), Pn = pn (n = l,2, ...), 

with > and /? > 0. Let us set p = v/ [3. It is well-known (cf. Cox and Miller 
[7]) that 



n = 0,l,... . 



Po,n(t) = ^ exp {-P (l - e-^*) } 



, . . . , 



n! 

Then (see Eq. n. 3.383 of Gradshteyn and Ryzhik |lUj . pag. 318), 

vfo,„(A) = {;e-ii?(n + l,A)c,Q,^ + , + l;,), „ = o, 1 
where -B(a, b) = T{a) r(6)/r(a + b) is the Beta function and 

a>(a,c;x) = l + E{^^ 

n=l ^^'"^ 

is the confluent hypergeometric function of first kind (Kummer function) , with 
(a)„ = a{a + 1) • ■ ■ (a + n — 1). Hence, from we have: 

(52) 

In particular, the probability of having asymptotically zero individuals is: 

90 = e « 



In the special case (3 = from (|52|) we have: 



1 

A5. Immigration-birth-death process with catastrophes 

Let N{t) be the number of individuals present at time t in an immigration- 
birth-death process with catastrophes, characterized by state-space {0,1,...} 
and by birth and death rates 

an = an + v (n = 0, 1, . . .), f5n=Pn (n = l,2,...), 
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with a > 0, > and /? > 0. As is well-known, in absence of catastrophes for 
n = 0, 1, . . . there results: 



1 



1 fiy 



at 



1 + at J nl \a J n \l + at 

a — (3 



a e 



' ^ 1 









a 



a e 



{a-li)t _ 



a = P 



with 



j + vt, 



E[iV(t)|iV(o)=j] 



J e 



{a-f3)t 



+ 



;("-/3)t _ I 



a = (3 



, a^ (3. 



a — (5 

Let us now consider the process in the presence of catastrophes, whose transient 
probabilities have been studied in ^S] by making use of a generating function 
approach. From ^ it follows: 

i + vt, a = (3 + i 

(53) 



E[7V(t) I iV(0) = j] 



+ 



g(a-/3-5)i _ 1 



a-f3-C 

It is interesting to note that the mean of N(t) identifies with that of N{t) if in 
Eq. (j53|l we substitute /3 + ^ with f3. Moreover, from (j53]) we have 



-, a < P + ^ 



lim E[N{t) I A^(0) = j] 



/3 + e-a' 

+00, a>(3 + ^. 

We shall now obtain the steady-state distribution of N{t). We recall that in 
absence of catastrophes the steady-state distribution exists only if a < /3. 
(i) Let a < (3. Then, 



7fo,n(A) 



1 / a 



a \P 



n+l 



1 ^ly 



ni \a J 



1 



^ --1 

a\a 



B 



A 



-,n + 1 



X F - + n, 



a (5 — a 



;n+ 1 + 



where: 



F{a,b-c-x) = 1 + ^ 



/?-«'/? 

a)n {b)n 



f3 — a 

n = 0, 1,..., 



^1 ™' 
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Hence, from H36|) it follows 



xF -+n,— + — , n = 0, 1, 

Va p — a p — a p J 

(ii) If a = /3, then 

vro,n(A) = - f-) f-V ^'f-+n,-;- 

a \a J „ \a J \a a a 



where 



-co 



r(a) Jo 

is the confluent hypergeometric function of the second kind. Since ^'(a — c + 
1, 2 — c; x) = x'^'^ ^(a, c; x), from we thus have: 

'?n = evfo,n(0 = f-V f-) ^f-+n,-;^V n = 0,l,.... 
In particular, from identity ^'(a, a; x) = r(l — a, x), we obtain: 



a J \ a a 



(iii) Finally, if a > /3 there results: 

an! \a/„ \ a/ \a — p a 

xF - + - + -; ^ + , n = 0, 1 

\OL a — p a a — p a a 



, J., . . . , 



that by virtue of (|36|) implies: 

an! Vo/n V o/ V« — P OL 

(v i V i V 3\ 

xF -+n,^- + -;— ^ + -+n + l;^ , n = 0, 1, . . , 
\a a — p a a — p a a) 
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